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reatment works. A generation of research has 
led to this inescapable conclusion. A vast body of liter- 
ature including complete textbooks, chapters, and 
aggressive public and professional education campaigns 
fully explicate this positive message. 13 Yet, among our- 
selves, we are generally less positive about the impact of 
our treatments on our patients' lives. We will agree that 
most patients do pretty well most of the time on most 
treatments. But we will also agree that this is not nearly 
good enough and much more needs to be learned about 
how treatments work. 

What, in particular, don't we know as well as we would 
like? Why do treatments rarely work as well in practice 



as they do in clinical trials? Why are the approaches to 
treatment that are studied in research settings rarely the 
ones that are used in practice? Does treatment enhance 
functioning? Does early treatment predict a more favor- 
able response? How can we keep people well once they 
have been made well? What approaches should be used 
for the treatment-resistant patient? 
These are the sorts of questions that are raised within 
the context of what has been called a public health 
model of treatment. 4 These are questions we cannot yet 
answer as well as we would like, however, largely 
because the direction and culture of treatment research 
has been determined by a more narrowly defined regu- 
latory model. 5 This regulatory model has been the dom- 
inant force shaping treatment research in the past and 
we will explore some of its limitations below. 

Traditional (regulatory) clinical trials: 
strengths and weaknesses 

Most treatment studies are done with a very specific pur- 
pose in mind: to gain approval or acceptance of a particu- 
lar therapeutic modality. These studies are usually referred 



The mental health field is transforming the culture of treatment research by moving from a narrow regulatory model geared 
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to as trials to establish efficacy. This type of consideration 
is appropriately referred to as a "regulatory" one. 
Research following the regulatory model is specifically 
geared to the legal requirements of drug approval and reg- 
istration. Although there is no equivalent to the Food and 
Drug Administration (FDA) for psychotherapy, the 
methodology of the regulatory model has been adopted in 
that field as well. In order to establish efficacy, it is essen- 
tial that pure disease entities are isolated. This has led to 
the practice of eliminating from clinical trials all patients 
with comorbid illnesses, coexisting conditions, and even 
potentially compromising psychosocial or environmental 
characteristics. Dimensions of outcome are limited to the 
direct symptomatic measures of that disease. Observation 
periods are, typically, very short. In order to prevent admin- 
istrative or delivery problems from masking the effect of 
the treatment, clinicians are carefully selected and trained. 
Intrusions such as the administrative requirements of a 
health care plan or third party payer are minimized, and 
the treatment is provided in optimal form, often in an aca- 
demic health center. Specific measures are taken to ensure 
compliance of the clinician with the protocol and adher- 
ence of the patient with the procedures and treatments. 
Formally, efficacy studies define optimal treatment out- 
comes for narrowly selected patients treated under rigidly 
controlled and ideal conditions. With a primary focus on 
symptoms, the assessment of efficacy is based upon the 
degree to which the level of symptomatology is reduced or 
ehminated. 67 In an efficacy trial, treatment is provided by 
specially selected and trained clinicians who provide opti- 
mal treatment and expend substantial resources to ensure 
compliance and minimize drop out. 
Research supported for commercial purposes, particularly 
that supported by the drug companies themselves, has, of 
necessity, conformed to the regulatory model. This is the 
case regardless of whether the site of the study is an acad- 
emic health center or a community treatment facility, and 
regardless of whether the coordination of the study is done 
directly by the sponsor or by an intermediary (contract 
research organization, or CRO). It is worth noting that 
those doing clinical psychotherapeutic or behavioral 
research have not (yet) adopted this CRO type of arrange- 
ment. The regulatory model has also been carried over into 
research that has no industrial sponsorship, even to 
research on mental disorders that has been directed to gov- 
ernment agencies or foundations. 

In a treatment study driven by a regulatory model of inves- 
tigation, there is no minimum effect size or minimum pro- 



portion of responders necessary. In addition, there is no 
requirement that the subject population be representative 
of the kind of patient seen in actual practice. As such, a trial 
done in accordance with the regulatory model represents 
only the beginning of a process of clinical development. 
Efficacy studies define optimal treatment outcomes for 
narrowly selected patients treated under rigidly controlled 
and ideal conditions. The classic efficacy trial is used to 
define the gold standard of the best outcome under ideal 
circumstances. Because of the tight standard of control 
required in efficacy studies, the policy and practice rele- 
vance of these trials will always be limited. 8 
The clinical trials of cognitive enhancers provide a useful 
example of the differences between regulatory and public 
health research. The trials of cognitive enhancers seek to 
show slowing or reversal of the progression of Alzheimer's 
disease or to demonstrate improved management of the 
symptoms of the disease. These trials typically attempt to 
show that the course of a progressive disease has been 
modified. The design of such trials involves great complex- 
ities even under optimal conditions. 9 In an effort to demon- 
strate efficacy within the regulatory model, current clinical 
trials involving antidementia compounds typically exclude 
any patient with psychiatric or neurologic symptoms or 
substance abuse, and require the patient to be generally 
physically healthy and living with a caregiver. Schneider et 
al 10 applied these criteria to a large, state-wide database in 
California and excluded all but 10% of patients. The result- 
ing sample was younger, less severely ill, more highly edu- 
cated, and more likely to be white and with higher incomes 
than the population as a whole. These sorts of data provide 
little guidance to the patient, family, or clinician in the 
selection of treatment approaches. 
In fact, there is a small but growing literature on issues 
relating to subject selection in clinical trials. 11 In schizo- 
phrenia, for example, subjects tend to be younger than the 
general clinical population and are more likely to be male 
and part of an ethnic minority. 12 In the Treatment Strate- 
gies in Schizophrenia (TSS) study, fewer than 10% of those 
screened were actually enrolled in the study. 12 The story is 
much the same in bipolar illness. In general, subjects 
enrolled in studies tend to have been ill for a very long 
time — 15 years in bipolar trials 13 — and are unstable or 
unsatisfied with their current treatment. Even in studies 
attempting to recruit first-episode patients, the period of 
undetected or untreated illness exceeds 3 years. 14 
Age itself is a common concern, with many studies having an 
arbitrary age cutoff of 55 or 60 years. Even "geriatric" studies 
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have been restricted, for all intents and purposes, to the 
"young-old" population of patients in their sixties. Few older 
patients have ever been studied, 15 despite the clear impact of 
advanced age on pharmacokinetics, dynamics, and drug 
metabolism 16 and on treatment response." In general, the rigid 
exclusions of most regulatory-oriented clinical trials have sig- 
nificantly distorted the conclusions of these studies. 

Public health model intervention studies 

Studies that are informed by a public health model are 
often called "effectiveness" studies. We avoid use of that 
term since it seems to convey multiple and conflicting 
meanings in different audiences. Public health studies bring 
us into the world of actual practice with time-pressured 
clinicians taking care of large numbers of patients with 
uncertain clinical presentations, complex comorbidities, and 
varying degrees of interference with ideal levels of compli- 
ance. The exclusive focus on symptomatology is expanded 
to include outcomes related to issues of function, disability, 
morbidity, mortality, resource use, and quality of life. The 
classic public health trial is used to assess the expected out- 
come under usual circumstances of practice. 18 
In contrast to the elegantly crafted efficacy trial, a public 
health trial must be bigger in size, simpler in design, broader 
in terms of inclusions and narrower in terms of exclusions, 
and more representative with respect to settings of care. 
These settings will not be limited to academic health centers 
or tertiary care institutions, but will include primary care, 
community settings, and long-term care institutions. Unlike 
efficacy trials, where specially trained clinicians carry out 
state-of-the-art assessment and treatment, public health tri- 
als are carried out in settings of usual practice where there is 
a broad and variable range of clinician expertise and experi- 
ence with the disorder under study. Outcome measures will 
necessarily extend beyond symptomatology to include func- 
tion, disability, morbidity, mortality, health care and other 
resource use, family burden, institutionalization, and quality 
of life. Public health studies are not simply secondary analy- 
ses of administrative data collected in large and naturalistic 
databases, but are treatment trials that are broadly repre- 
sentative of clinical, family, and organizational factors. 19 

Types of intervention research 

We begin with the assumption that the mental disorders 
of late life are chronic, recurring conditions. Within this 
broad perspective, three types of studies would seem to 



be appropriate. First are treatment trials including both 
short-term and long-term studies directed toward man- 
agement of symptoms, optimization of function, and min- 
imization of disability. Treatment trials of this kind are 
common and well recognized in the field. The methodol- 
ogy of these trials is well established and accepted by all 
those involved in clinical care. However, the conceptual- 
ization of the nature of treatment response is broader in 
public health trials than in regulatory trials. Rather than 
focusing exclusively on response as a dichotomous vari- 
able, ie, responder or nonresponder, a public health 
approach requires in addition that attention be paid to 
speed of response, completeness of response, and dura- 
bility of response. 

An intervention directed at the speed of response fits 
within an overall conceptualization of treatment. The 
question is how can we accelerate the response to treat- 
ment and how early in the treatment process can we 
know when an approach to treatment is likely to fail? A 
related question concerns the management of treat- 
ment-resistant cases. Regardless of how treatment 
response is defined, we know that invariably a subset of 
patients show incomplete responses or nonresponse to 
any given treatment intervention. Under the regulatory 
model, the management of nonresponders and partial 
responders receives relatively little attention. Yet treat- 
ment-resistant patients make up a significant portion of 
actual clinical practice and they account for a major 
share of the mortality, morbidity, and cost of mental ill- 
ness. Therefore, a public health orientation requires that 
the management of treatment resistance be a priority 
for investigation. 

An intervention directed at the completeness of response 
is considered rehabilitative. The question is how well is 
well and can we improve the nature of response by tar- 
geting interventions to reduce residual symptomatology 
posttreatment? A rehabilitative strategy might entail aug- 
mentation with a new pharmacologic or psychothera- 
peutic agent or some significant alteration in lifestyles 
and circumstance. 

An intervention directed at durability of response is con- 
sidered preventive. The question is once well, how can 
we stay well and can we reduce the risk of relapse (of the 
same episode) or recurrence (of a new episode) through 
some longer term approaches to treatment? Interven- 
tions are also preventive if they target the excessive lev- 
els of disability that often characterize the mental disor- 
ders of older people. As we learn more about the risk 
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factors, etiology, and pathophysiology of mental disor- 
ders in late life, it is conceivable that preventive inter- 
ventions could be directed toward delaying the onset of 
disease or even preventing the onset entirely. 20 

Infrastructure considerations 
for public health model studies 

In order to carry out such studies, whether they are 
treatment studies, preventive interventions, or rehabili- 
tative interventions, we need to identify the structural 
barriers in the ways in which research is organized and 
to innovate approaches to address these barriers. 
Researchers and their laboratories are largely based in 
academic health centers. The role of the academic health 
center is being redefined in the context of health care 
system reorganization, and access to patients has become 
problematic. Patient-oriented research is seen as a par- 
ticularly fragile enterprise at this point in time. 2122 
There are important opportunities emerging, however. 
Many academic health centers are part of clinical systems 
that include community hospitals, primary care and spe- 
cialty care office practices, and capitated contracts. The 
nonacademic settings of these large networks are where 
the majority of patients are located. The new challenge 
for the field is how to turn these clinical and administra- 
tive networks into research networks for the develop- 
ment and management of intervention trials. At the same 
time, the parallel challenge is how to identify the critical 
elements of academically based protocols and paradigms, 
and adapt them for use in the broader community. 
Advancement for academic investigators is based on 
research productivity, usually measured by significant 
publications and success in developing extramural fund- 
ing. Large-scale, longitudinal, public-health-oriented stud- 
ies typically have a very long period of time before impor- 
tant publications are developed, and they usually involve 
the participation of a large number of investigators. Indi- 
vidual intellectual contributions can be difficult to assess 
in such projects. If there is a commitment to developing 
this type of research, the challenge for the field is how to 
adapt promotion and tenure policies to this situation so 
as to properly recognize individual contributions. 
Similarly, much of the training of new investigators is 
based upon a model of individual scientific activity: the 
independent investigator directing a small group of junior 
colleagues, fellows, students, and technicians. Training typ- 
ically does not prepare investigators for participation in 



large-scale endeavors. Nor are there established training 
pathways into some of the newer roles in large-scale stud- 
ies, database management, clinical coordination, site man- 
agement, etc. 

Issues in 
priority setting 

Determination of priorities within this broad panorama 
of intervention research is always the result of the com- 
plex interaction between public health need and scien- 
tific opportunity. However, this is not as straightforward 
as it appears. We can estimate public health need in 
many ways. Death, disability, and societal and family 
burden have each been proposed as the sole criterion 
for policy determination. For example, in the influential 
text The Global Burden of Disease, 23 major depression, 
bipolar disorder, schizophrenia, and obsessive compul- 
sive disorder are all included on the list of the 10 lead- 
ing causes of disability worldwide. In fact, major depres- 
sion is identified as the leading cause of disability. On 
the other hand, in that same study, no mental disorder 
is included as a leading cause of death worldwide. 
The identification of significant areas of scientific oppor- 
tunity is equally problematic, with investigators from dif- 
ferent fields advocating on behalf of substantial increas- 
es in the investment in their particular areas of interest. 
The National Advisory Mental Health Council, with the 
legislative mandate to guide policy development and 
program support, has become a valuable sounding board 
for the identification of promising scientific opportuni- 
ties. This Council has produced recent reports on genet- 
ics research, 24 prevention research, 25 and the interface of 
clinical trials and mental health services research. 26 
Priority setting must be part of a continuing process of 
programmatic adjustment, readjustment, and redirection 
in the field. New treatments must be developed as our 
knowledge base of basic and clinical neuroscience and 
behavioral science expands. Established treatment 
approaches must be fine-tuned in accordance with the 
needs of patient populations and the settings in which 
they receive care. Research must catch up with practice 
and evaluate the many common approaches to treatment 
that have developed without a firm base of research. Here 
we include such approaches as continuation and mainte- 
nance electroconvulsive therapy, reduction or taper strate- 
gies, treatment algorithms or decision trees for patients 
with treatment refractory illness, and unusual treatments 
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such as methylphenidate for minor depression. A wealth 
of potentially promising treatment approaches currently 
exists in the form of case reports, uncontrolled studies, 
letters to the editor, and Internet postings. A major goal 
for the public health enterprise will be to organize and 
systematically study these interventions and identify those 
which are clinically valuable and those which are not. 
As part of a public health mission, we must also attend 
to issues of safety and consumer protection. For exam- 
ple, the widespread use of over-the-counter, unregulated 
treatments needs to be carefully examined for possible 
benefit and for potential harm. Use of complementary 
and alternative approaches is very high. 2728 Even in 
patients volunteering for participation in clinical drug 
trials, use of herbal medications is substantial; in a series 
of 150 such subjects, Emmanuel and colleagues 29 report 
that 56% have used herbs in the last month. It is there- 
fore incumbent upon us to evaluate these treatments, 
including natural products such as St John's Wort or 
kava, psychophysiologic approaches such as eye move- 
ment desensitization and reprocessing (EMDR), and 
somatic approaches such as acupuncture, if for no other 
reason than that our patients are using these in large, 
uncontrolled, natural experiments. 
A final priority must be dissemination. Our patients are 
not helped by treatments that are available in only in sci- 
entific journals. A recent example highlights the prob- 
lem. Lehman and Steinwachs 30 report that fewer than 
half the patients with schizophrenia in the United States 
received a level of care that was consistent with the cur- 
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rent state of the art. This is an important finding that can- 
not be ignored. As a field we must take on the challenge 
of translating our research into practice and placing the 
most powerful clinical tools in the hands of patients, their 
families, and the clinicians that care of them. 



Conclusion 



The mental health field is significantly altering the cul- 
ture of treatment research by moving from a narrowly 
defined regulatory model to a more inclusive public 
health model. This new approach to intervention promis- 
es to improve patient care by addressing the types of 
practical questions and functional outcomes that are typ- 
ically brought to the attention of clinicians. This new gen- 
eration of research is directed toward defining standards 
of appropriate and cost-effective treatment for the 
diverse population of patients seen in all health care set- 
tings. This should not be taken to indicate that there is no 
place for the highly controlled efficacy research needed 
to establish that a treatment has merit. But rather it is 
now the case that efficacy is the beginning of a process of 
inquiry and not the end. The interdependence of chal- 
lenge and opportunity, often used as a cliche, should be 
considered real and entirely appropriate in this instance. 
The challenge to all of us as patients, clinicians, scientists, 
or educators is great. We are all having to learn to do new 
things. At the same time, there is a wonderful opportuni- 
ty to have a significant impact on improving patient care. 
This opportunity is too good to miss. □ 
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Una aproximacion de salud publica a las terapias 
clinicas en psiquiatha: direcciones para nuevas 
investigaciones 

El campo de la salud mental esta transformando la 
cultura de la investigation terapeutica al movili- 
zarse desde un estrecho modelo regulatorio orien- 
tado a la aprobacion y registro de medicamentos 
hacia un modelo de salud publica mas inclusivo. Asi 
mientras los ensayos antidemencia regulados 
excluiran pacientes con sintomas psiquiatricos, neu- 
rologicos o con abuso de sustancias y requieren 
que ellos esten fi'sicamente sanos y que vivan con 
un cuidador, es deck, el 90% de la poblacion que 
presenta Enfermedad de Alzheimer, el modelo de 
salud publica promueve mejorar el cuidado del 
paciente senalando los tipos de preguntas practi- 
cas y evoluciones funcionales que tipicamente inte- 
resan a los clinicos: j_EI tratamiento mejora la fun- 
cion? tComo podemos mantener bien a las 
personas una vez que el las se han recuperado? 
iPor que los tratamientos no resultan efectivos en 
la practica como ocurre en los ensayos clinicos? Los 
estudios de salud publica son conducidos en la 
practica mundial actual por clinicos presionados 
por el tiempo, quienes cuidan de un gran numero 
de pacientes con cuadros clinicos poco precisos, 
comorbilidades complejas y diversos grados de 
interferencia con los niveles ideales de adherencia. 
El foco exclusivo de sintomas se expande para 
incluir evoluciones relacionadas con temas de fun- 
cion, incapacidad, morbilidad, mortalidad, uso de 
recursos y calidad de vida. La investigation de la 
eficacia altamente controlada todavia es necesaria 
para establecer el valor de un tratamiento, pero la 
eficacia marca por ahora solo el comienzo del pro- 
ceso de investigation. 
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Une approche de Sante publique des 
therapeutiques cliniques en psychiatrie : 
nouvelles voies de recherche 

Le cadre conceptuel de la recherche therapeutique 
dans le domaine de la sante mentale est en train de 
connaitre une profonde mutation la faisant evoluer du 
modele reglementaire etroit concerne uniquement par 
I'enregistrement et I'autorisation de mise sur le marche 
du medicament vers un modele de Sante publique plus 
global. Ainsi, les etudes reglementaires classiques por- 
tant sur les medicaments traitant la demence excluent 
les patients presentant des symptomes psychiatriques 
et neurologiques ou les toxicomanes, et exigent qu'ils 
soient en bonne sante physique et qu'ils vivent avec un 
soignant. Ceci a pour consequence d'eliminer 90 % de 
la population presentant une maladie d Alzheimer. Au 
contraire, le nouveau modele de Sante publique vise a 
ameliorer la prise en charge des patients en donnant la 
priorite aux preoccupations specifiques des cliniciens, 
qu'il s'agisse des aspects pratiques ou de ceux concer- 
nant les resultats : Est-ce que le traitement facilite le 
bon fonctionnement des patients ? Comment mainte- 
nir les patients dans un etat de bonne sante mentale 
apres avoir reussi a les equilibrer ? Pourquoi les traite- 
ments ne sont-ils pas aussi efficaces en pratique que 
lors des etudes cliniques ? Les etudes de Sante publique 
sont menees dans les conditions reelles de pratique 
avec des cliniciens presses par le temps, prenant en 
charge un grand nombre de patients avec des tableaux 
cliniques incertains, des comorbidites complexes, et des 
degres variables d'interferences avec les niveaux d'ob- 
servance ideaux. Ainsi, le centre d'interet autrefois diri- 
ge exclusivement sur les symptomes s'est elargi pour 
integrer les notions de fonctionnement du patient, de 
handicap, de morbidite, de mortalite, d'utilisation des 
ressources et de qualite de vie. Si la demonstration de 
la valeur du traitement passe toujours par les essais de 
recherche d'efficacite hautement controles, ces der- 
niers ne representent desormais que I'etape initiale du 
processus d 'investigation. 
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